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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
December 18, 2006 has been entered. 

Response to Amendment/Arguments 

2. Claims 1-29 are still pending. 

3. Applicant amended the claims by replacing "smoothing" with "unsharpening." 
However, per P. 16, lines 4-5 of the response, "smoothing" and "unsharpening" are 
considered by applicant as the same; therefore the corresponding amendment has no 
effect on the affected claims. Additionally, applicant also amended the claims by 
replacing "sharpening" with "restoring." 
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4. Applicant's arguments filed 12/18/06 have been fully considered but are moot in 
view of the new grounds of rejection; see below. 



Claim Objections 

5. Claims 6, 20, 23 and 26 are objected to because of the following informalities: 

• Claim 6, last line: for clarity consider changing "restored" to "being restored;" do 
the same for claim 26 

• Claim 20, line 3: for clarity consider changing "block said edge" to read "block in 
said edge" 

• Claim 23, last line: for clarity consider changing "near region said edge" to read 
"near region of said edge" 

Appropriate correction is required. 

Claim Rejections - 35 USC §112 

6. The following is a quotation of the second paragraph of 35 U.S.C. 112: 



The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 
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7. Claims 1-7, 10, 11, 18, 19 and 25-27 are rejected under 35 U.S.C. 112, second 
paragraph, as being indefinite for failing to particularly point out and distinctly claim the 
subject matter which applicant regards as the invention. 

8. Claim 1 recites a method for sending coded information (lines 1-2), as well as a 
coding apparatus and a decoding apparatus (line 4 through the last line). It is not clear 
whether it is a method or an apparatus that is being claimed; therefore the mete and 
bound of the claim cannot be ascertained. Claims 2-7 inherit this problem and are 
similarly rejected. 

9. Claim 5, and similarly claim 25, recites the limitation "the relationship" in line 4. 
There is insufficient antecedent basis for this limitation in the claim. Claims 6, 7, 26 and 
27 inherit this problem from their respective parent claims and are similarly rejected. 

10. Claim 10, and similarly claim 18, recites the limitation "said density levels" in line 
3 and "said density level" in line 5. There is insufficient antecedent basis for this 
limitation in the claim. Claims 1 1 and 19 inherit this problem from claims 10 and 18, 
respectively, and are similarly rejected. [Note: While parent claim 9 recites "density 
levels" in line 3, they are for a set of pixels which may or may not be from "the 
predetermined region" recited in line 4 of claim 10 and therefore is insufficient as an 
antecedent basis. For examination purpose "said density levels" in line 3 and "said 
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density level" in line 5 will be interpreted as "density levels" and "the density level," 
respectively.] 



Claim Rejections - 35 USC § 103 



1 1 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 



12. Claims 1, 8, 16, 28, and 29 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Fu et al. (US 5,703,965), in view of Mitra et al. (US 5,426,673). 



13. Regarding claim 1, Fu discloses 

• extracting edge information which is binary information representing an 
edge part of said original image 

[Fig. 5, ref. 302 and Col. 14, lines 8-9 (edge file). Note that the 
edge file contains binary edge information indicating whether a pixel is 
or is not a pixel, along with their color values. See also Fig. 3 and 
Col. 18, lines 48-52 (binary edge information)] 

• obtaining coded edge information by coding said edge information 
according to a first coding algorithm 

[Fig. 5, ref. 304 and Col. 14, lines 19-22. Note that the binary edge 
information is encoded along with other information] 

• obtaining coded density information by coding said density information 
of said image according to q second coding algorithm 

[Fig. 5, ref. 312 (same as Fig. 3, ref. 312) and Col. 8, lines 53-58. 
Note that Fu does not expressly disclose that said image is edge 
unsharpened image; this is taught by Mitra, see below] 

• sending said coded edge information and said coded density information 
as said coded information to said image decoding apparatus 

[Fig. 5, refs. 306 & 314] 
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• obtaining said edge information by decoding said coded edge information 
according to a first decoding algorithm corresponding to said first 
coding algorithm 

[Fig. 5, ref. 402 and Col. 14, lines 30-32] 

• obtaining said density information of said image by decoding said coded 
density information according to second decoding algorithm corresponding 
said second coding algorithm 

[Fig. 5, ref. 316 (same as Fig. 3, ref. 316) and Col. 8, line 63-Col. 9., 
line 3] 

• obtaining said reproduced image from said density information of said 
image by restoring said edge part of said image by using said edge 
information 

[Fig. 5, ref. 500 and Col. 14, lines 32-35; see also Fig. 12 for 
detailed sharpening operation. Note that the edge part is restored by 
sharpening (using the edge information) and the edge-restored image is 
the reproduced image] 

• wherein said second coding algorithm and said second decoding algorithm 
are based on a standard coding method using a discrete cosine transform 
[Fig. 5, refs. 312 & 316 (same as Fig. 3, refs. 312 & 316); Col. 8, 
lines 53-58 and Col. 8, line 63-Col. 9, line 3. Note that JPEG is based 
on DCT] 



Fu does not expressly disclose the that said image is an edge unsharpened image nor 
the following, but Mitra does 

• obtaining density information of an edge unsharpened image from said 
original image by unsharpening said edge part 

[Col. 1, lines 45-48. Note that the image is edge-smoothed (i.e., edge- 
unsharpened) before encoding] 

« 

Fu and Mitra are combinable because they both have aspects that are from the same 
field of endeavor of compression. 



At the time of the invention, it would have been obvious to one of ordinary skill in the art 
to modify Fu with the teachings of Mitra by edge-unsharpening an image before 
encoding. The motivation would have been to reduce the size of the compressed image 
data because the smoothed part will have less variation, which typically results in better 
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compression because compression schemes take advantage of redundancy in data and 
less variation means more redundancy. 

Therefore, it would have been obvious to combine Mitra with Fu to obtain the invention 
as specified in claim 1 . 

14. Regarding claim 8, note that the combined invention of Fu and Mitra further 
discloses the recited coding apparatus [Fu: Fig. 1, 102 (Source System); Fig. 2 
(hardware platform for either the source system or the destination system); Fig. 5, 
"Source System;" Col. 6, lines 16-20 & 39-65. Note that Fig. 5 shows the edge 
extracting part (302), the first coding part (304) and the second coding part (312), all 
implemented in software and it would have been obvious to also implement the edge 
unsharpening operation taught by Mitra in software as a part of the apparatus since the 
CPU is the only device in the apparatus of Fig. 2 capable of carrying out such operation 
and adding another piece of computing device (for unsharpening) will increase cost. 
Note further that the combined invention of Fu and Mitra discloses all functions 
performed by the parts recited in claim 8, per the analysis of claim 1], 

15. Regarding claim 16, and similarly claims 28 (which is a broader version of claim 
16), note that the combined invention of Fu and Mitra further discloses the recited a 
decoding apparatus [Fu: Fig. 1, 106 (Destination System); Fig. 2; Fig. 5, "Destination 
System;" Col. 6, lines 16-20 & 39-65. Note that Fig. 5 shows the first decoding part 
(402), the second decoding part (316) and the edge restoring part (500), all 
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implemented in software. Note further that the combined invention of Fu and Mitra 
discloses all functions performed by the parts recited in claim 16, per the analysis of 
claim 1]. 

* 

16. Regarding claim 29, note further that the analysis of claim 1 6 discloses using a 
first decoding part (i.e., the edge decoding part) for obtaining said edge information. 

***** 

17. Claims 2-4, 12, 13, 15, 20-22 and 24 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Fu et al. (US 5,703,965) and Mitra et al. (US 5,426,673) as 
applied to claims 1, 8, 16, 28, and 29 above, and further in view of Vlahos et al. (US 
6,363,526). 

18. Regarding claim 2, the combined invention of Fu and Mitra discloses all 
limitations of its parent, claim 1. 

The combined invention of Fu and Mitra does not expressly disclose the following, but 
Vlahos does 

• performing first matrix operation by using a first block density 

information vector and unsharpening matrix, wherein said first block 
density information vector is obtained by arranging density information 
of each pixel included in a first block, said first block includes a 
pixel in said edge part or in a near region of said edge part and 
includes pixels in a surrounding region around said pixel, and order of 
said first block density information vector corresponds to the number of 
pixels in said first block, and wherein said unsharpening matrix 
includes coefficients used for edge unsharpening which operate on 
density information of each pixel in said first block 
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[7, ref. 5; Col. 3, lines 49-56; Col. 6, lines 13-15. Note that the 
first block is either a 1x3 or a 3x1 pixel block (considered as a 3 rd 
order vector, per P. 25, lines 20-27 of the instance application) and 
the coefficients of the corresponding unsharpening matrix have values of 
a (=0.5) at the center and (1-a)/ 2 (=0.25) at each of the other two 
locations ] 

• obtaining unsharpened density information of each pixel by overlaying 
density information of each pixel in said first block obtained by 
performing said first matrix operation on each pixel while scanning said 
original image pixel by pixel 

[Col. 3, lines 49-56. Note that the weighted average reflects the 
overlaying. Note further that per Col. 5, lines 6-30 the image is 
scanned pixel by pixel] 



The combined invention of Fu and Mitra is combinable with Vlahos because they both 
have aspects that are from the same field of invention of image enhancement. 



At the time of the invention, it would have been obvious to one of ordinary skill in the art 
to modify the combined invention of Fu and Mitra with the teaching of Vlahos as recited 
above. The motivation for doing so would have been because the smoothing approach 
of Vlahos has provided good results in cleaning edge artifacts, among other things, as 
Vlahos indicated in Col. 4, lines 35-37. 



Therefore, it would have been obvious to combine Vlahos with Fu and Mitra to obtain 
the invention of claim 2. 



19. Regarding claim 3, note that it is drawn to the application of a matrix for the 
restoring operation (which is effected by sharpening); the application of the restoring 
matrix is identical to the application of the unsharpening matrix recited in claim 2 except 
for the specific matrix used. Since, as applicant admitted in lines 3-4 on page 16 of the 
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12/18/06 response, sharpening (i.e., restoring) is essentially the inverse of smoothing, it 
would have been obvious to one of ordinary skill in the art to use the inverse matrix of 
the unsharpening matrix for the sharpening operation (and therefore result in the 
restoration of the edges) and the motivation would have been to ensure that the image 
after sharpening will be restored to the original image (since the inverse of a function is 
expected to cancel the effect of that function). With this, claim 3 is similarly analyzed 
and rejected as per the analysis of claim 2. 



20. Regarding claim 4, Vlahos further discloses 



• obtaining density information x' of a pixel of said edge part of said 
edge unsharpened image according to a first equation x'=(l-A)x+ AC) , 
wherein, A is a positive constant, x is density information of said 
pixel of said original image, and C is surrounding density information 
representing density state of surrounding region of said pixel 
[Col. 3, lines 49-56. See also the analysis of claim 2. Note that A 
and C above correspond to 0.5 and (A+B)/2, where A and B are the two 
adjacent {to the left and right; or above and below) pixels of the pixel 
to be smoothed] 



21 . Claim 12 is similarly analyzed and rejected as per the analysis of claim 2 (also 
per the analysis of claim 8 re being a part of the apparatus). 



22. Regarding claim 13, the combined invention of Fu, Mitra and Vlahos further 
discloses 

• a pixel judgment part for judging whether a pixel exists in said edge 
part or in a near region of said edge part while scanning said original 
image pixel by pixel 

(Fu: Fig. 5, ref. 302 (edge detection). Note that per P. 25, lines 7-8 
of the instance application, depending on the value of e, the edge near 
region can be as small as just consisting of the edge part or as large 
as the entire image; therefore Fig. 302 performs the recited judging 
function because it determines whether a pixel is an edge pixel or not. 
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See also the analysis of claim 8 regarding being a part of the 
apparatus ] 

• the matrix operation part for performing, when said pixel exists in said 
edge part or in said near region, matrix operation by using a block 
density information vector and unsharpening matrix, wherein said block 
density information vector is obtained by arranging density information 
of each pixel included in a block, said block includes said pixel and 
pixels in a surrounding region around said pixel, and order of said 
block density information vector corresponds to the number of pixels in 
said block, and wherein said unsharpening matrix includes coefficients 
used for edge unsharpening which operate on density information of each 
pixel in said block 

[Mitra: Col. 1, lines 45-48 {smoothing, or unsharpening, edges). 
Vlahos: Col. 3, lines 49-56 (using matrix operation for smoothing 
edges) ; see also the analysis of claim 2] 



23. Claim 15 is similarly analyzed and rejected as per the analysis of claim 4 (also 
per the analysis of claim 8 re being a part of the apparatus). 



24. Claims 20 and 21 are similarly analyzed and rejected as per the analysis of claim 
3 (also per the analysis of claim 16 re being a part of the apparatus). [Specifically, 
regarding claim 20, as per the analysis of claim 16, the restoring matrix generation part 
and the matrix operation part can be implemented in software (i.e., computer programs) 
residing in the memory of a computer and to be executed by its CPU). Regarding claim 
21 , note that the analysis of claim 3 teaches using the inverse of the unsharpening 
matrix as the restoring matrix.] 

25. Regarding claim 22, Fu further discloses judging whether a pixel exists as an 
edge pixel or in a near region [Fig. 12, ref. 1202 and Col. 18, lines 62-64 (determining 
whether a pixel is on an edge or in a near region; for what constitutes a near region, see 
the analysis of claim 1 3)]. In addition, per the analysis of claim 3, the application of a 
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matrix operation in the recited manner using a restoring matrix (the inverse of the 
unsharpening matrix) to obtain restored density information has been disclosed by the 
combined invention of Fu, Mitra and Vlahos. Also see the analysis of claim 16 re being 
a part of the apparatus. 

26. Claim 24 is similarly analyzed as per the analyses of claims 3 and 22 (also per 
the analysis of claim 16 re being a part of the apparatus). 

***** 

27. Claims 9 and 17 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Fu et al. (US 5,703,965) and Mitra et al. (US 5,426,673) as applied to claims 1,8,16, 

28. and 29 above, and further in view of Acharya et al. (US 6,229,578). 

28. Regarding claim 9, the combined invention of Fu and Mitra discloses all 
limitations of its parent, claim 8. 

The combined invention of Fu and Mitra does not expressly disclose the following, 
which is disclosed by Acharya: 

• said edge unsharpening part including a density information correction 
part for correcting density information of each pixel such that 
variation of density levels represented by density information of pixels 
which are arranged across said edge part in a near region of said edge 
part of said original image is lowered 

[Fig. 1, refs. 140&160 (density information correction); Col. 5, lines 
12-44. Note that in ref. 160 the variation of density levels of pixels 
in a near region of edge is lowered since the pixels are median- 
filtered. Note further that per P. 25, lines 7-8 of the instance 
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application a near-region can be as large as the entire image; 
therefore a pixel is either an edge pixel or is in a near region] 

The combined invention of Fu and Mitra is combinable with Acharya because they both 
have aspects that are from the same field of endeavor of image enhancement. 

At the time of the invention, it would have been obvious to one of ordinary skill in the art 
to modify the combined invention of Fu and Mitra with the teaching of Acharya as 
recited above. The motivation for doing so would have been to remove noise without 
blurring the edge, as Acharya indicated in Col. 5, lines 40-44. . 

Therefore, it would have been obvious to combine Acharya with Fu and Mitra to obtain 
the invention of claim 9. 

29. Regarding claim 17, since it's purpose is to restore the edge part that has 
undergone the correction process recited in claim 9, it therefore would have been 
obvious to reverse the correction process of claim 9 (i.e., to correct in such a manner 
that the density variation is increased, as opposed to decreased as in claim 9) and the 
motivation would have been to counter the effect of the correction of claim 9 in the 
coding process in order to restore the density level of the edge pixel such that it is close 
to its original value. 
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Allowable Subject Matter 

30. Claims 14 and 23 are objected to as being dependent upon a rejected base 
claim, but would be allowable if rewritten in independent form including all of the 
limitations of the base claim and any intervening claims. 

31. Claim 5-7, 10, 1 1, 18, 19 and 25-27 would be allowable if rewritten to overcome 
the rejection(s) under 35 U.S.C. 112, 2nd paragraph (including those inherited from their 
respective base claim and any intervening claims, if applicable), set forth in this Office 
action and to include all of the limitations of the base claim and any intervening claims. 

32. The following is a statement of reasons for the indication of allowable subject 
matter: 

A. Regarding claim 5, and similarly claim 25, closest art of record Webb et al. (US 
6,621 ,909) discloses a steepest-descent method to find a solution that minimizes a 
squared error [Col. 4, lines 32-67]; it also would have been obvious to one of ordinary 
skill in the art at the time of the invention to use the inverse of the unsharpen equation 
recited in claim 4 (which is taught by Vlahos) that can be expressed as x = (x' - AC)/ (1- 
A) as the predetermined equation to perform the sharpening (i.e. restoring) operation. 
However, it would not have been obvious for one of ordinary skill in the art to be 
motivated to use the restoring equation according to a steepest descent method since it 
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would have been obvious to apply the inverse of an operation directly (i.e., using x as 
the restored density value) in order to negate the effect of the operation (which has 
been previously applied) so as to restore the original data. 

» 

B. Regarding claim 10, and similarly claim 18, closest art of record Lee et al. (US 
5,612,744) recites a mean-preserving smoothing operation [Fig. 2, ref. 26; Col. 4, lines 
21-27] but provides no detail; Chen et al. (US 6,330,371) discloses using mean filtering 
[Col. 7, lines 19-23]; Acharya et al. (US 6,229,578) discloses smoothing edge and non- 
edge pixels using different methods (averaging of neighboring edge pixels and median 
filtering, respectively); Kaplan et al. (US 5,533,149) discloses smoothing pixels of 
interest near an edge [Figs. 1-4] using least square regression. 

However, none of the references cited above, alone or in combination, disclose, 
teach or suggest density correction by calculating the mean of a predetermined region, 
comparing the value of each pixel in a second region (a near region, not necessarily 
identical to the predetermined region) to the mean, and adjusting the pixel value upward 
or downward depending on whether its value is lower or higher than the mean. [Note: 
In mean filtering the value of the center pixel of a window is replaced by the mean pixel 
value of the window; no judging step as recited in claim 10 is needed; in addition, non- 
center pixels are not replaced by the mean value of the pixels in the window.] 
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C. Regarding claim 14, and similarly claim 23, while closest art of record Futamura 
(5,791,271) discloses generating distance map [Fig. 6, ref. S32; Figs. 7A, 7B, 8; Col. 6, 
lines 37-53] and based on the distance, determining whether a pixel is on or near an 
edge [Fig. 6, ref. S33; Col. 6, lines 54-55, 62-64], it would not have been obvious for 
one of ordinary skill in the art at the time of the invention be motivated to modify the 
combined invention of Fu, Mitra and Vlahos with such teachings. This is because in the 
analysis of claim 1 3 (the parent claim), either the entire image or only the edge part is 
considered a near region (per P. 25, lines 7-8 of the instance application, since the 
value of z can be so large as to include the entire image or so small as to consist only of 
edge pixels) of the edge part; in either case there clearly is no need to carry out 
distance conversion. 

Conclusion and Contact Information 

33. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure: 

• George et al. (U.S. 5,453,844) - discloses the relationship between smoothing 
and compression efficiency, namely, greater smoothing yields better 
compression [Col. 8, lines 45-48] 

34. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Yubin Hung whose telephone number is (571) 272- 
7451. The examiner can normally be reached on 7:30 - 4:00. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Matthew C. Bella can be reached on (571) 272-7778. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

JYiibin Hung 
Patent Examiner 
Art Unit 2624 
March 12, 2007 




